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Irregular  Challenges 


Catastrophic  Challenges 


Development:  Need  for  Space,  Air,  Ground, 
Water,  Underwater  Software-Intensive  Systems 
that  are  Interconnected 


•  Several  million  SLOG  programs;  “Hybrid” 
systems  combining  legacy  re-use,  COTS, 
new  development 

•  Multi-contractor  teams  using  different 
processes:  dispersed  engineering, 
development  &  operational  locations 

•  New  technologies  create 
opportunities/challenges: 

products  change/evolve,  corporations  mutate 

•  Business/operational  needs  change  -  often 
faster  than  full  system  capability  can  be 
implemented 

•  Skillset  Shortfalls:  Cost  and  schedule 
constraints 

•  Demands  for  increased  integration, 
interoperability,  system  of  system  capabilities 

•  Enterprise  perspectives/requirements: 
sustainment  concerns 


Prevent  Acquisition 
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Defend 
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Traditional  Challenges 


Shape  Choices  Of 
Countires  At  Strate{^> 
CrossKMj^ 


Disruptive  Challenges 


Development  Complexity  of 
Software-Intensive  Systems 
is  Increasing  _ 
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Catastrophic  Challenges 


Software  Engineering  Trends  That  Impact  Systems 
Engineering 


Irregular  Challenges 


Traditional  Challenges  Disruptive  Challenges 


Traditional 

•  Standalone  systems 

•  Mostly  source  code 

•  Requirements-driven 

•  Control  over  evolution 

•  Focus  on  software 

•  Stable  requirements 

•  Premium  on  cost 

•  Staffing  workable 


Future 

•  Everything  connected-maybe 

•  Mostly  COTS  components 

•  Requirements  are  emergent 

•  No  control  over  COTS  evolution 

•  Focus  on  systems  and  software 

•  Rapid  change 

•  Premium  on  value,  speed,  quality 

•  Scarcity  of  critical  talent 


Emerging  Dynamics  of  Bringing  Systems  and  Software  Engineering  in 

Continued  Partnership 


How  Evolving  Trends  in  Systems  and  Software 
Technologies  Bode  Well  for  Advancing  the  Precision  of 

Carne^e Mellon  Technology  4 

^  Dr.  Kenneth  E.  Nidiffer 

_ ©2008  Carnegie  Mellon  University _ 


Software  Engineering  Institute 


Irregular  Challenges  Catastrophic  Challenges 


The  Acceleration  of  Innovation  in  the  21st  Century: 
-  Impacting  Both  Defense  and  Society 
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Augustine’s  Law:  Growth  of  Software  -  Order  of 
Magnitude  Every  10  Years 
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Catastrophic  Challenges 
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Irregular  Challenges 


Catastrophic  Challenges 


Trend  &  Implications:  Augustine’s  Law  Will  Hold 
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Disruptive  Challenges 


2080?  F-50  -  4, 7B  Lines  of  Code 


Need  for  increased  functionality  will  be  a  forcing  function  to  bring  the 
fields  of  software  and  systems  engineering  closer  together 
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Catastrophic  Challenges 


Irregular  Challenges 


Moore's  Law:  The  Number  of  Transistors  That  Can 
Placed  on  an  Integrated  Circuit  is  Doubling 
Approximately  Every  Two  Years 
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Relationship  Between  Complexity  and 
Acquisition  Success  Improving  and  More 
Improvements  are  on  the  Way 


Irregular  Challenges 


Catastrophic  Challenges 


Shape  Choices  Of 
Countires  At  Strategic 
Crossroads 


Software  is  Growing  in  Complexity 

•  80%  of  some  weapon  system 
functionality  is  dependent  upon  software 

•  Consequences  of  software  failure  can  be 
catastrophic 

Software  Acquisition  is  Difficult 

•46%  are  over-budget  (by 
an  average  of  47%)  or  late 
(by  an  average  of  72%) 

•“Successful  projects”  have 
68%  of  specified  features 

Software  is  Pervasive 

•  IT  Systems,  C4ISR,  Weapons,  etc 

On-going  Changes  to  the  Acquisition 
Process  Targeted  at  Correcting  this  Issue 


Traditional  ChallengQS  Disruptive  Challenges 


■o 


0) 

Q. 


Standish 

Group  CHAOS  Report 

2006  ' 

35% 

1  19%  1 

46% 

- 

1  1  1  1  1  n 

2004 

1  29%^ 

1  18%  1 

^3%  1 

- 

1  1  1  1  1  1 

2002 

1  34%^ 

1  15%  1 

51%  1 

- 

1  1  1  1  1  1 

2000 

1  28% 

1  23%  1 

49%  1 

- 

1  1  1  1  1  1 

1998 

1  26%  f 

28%  ^ 

46%  1 

- 

1  1  1  1  1  1 

1996 

1  27% 

1 

H  33% 

- 

1  1  1  1  1  1 

1994 

16% 

53% 

1 

0%  20%  40%  60%  80%  100% 

□  On-time  On  budget  □  Cancelled  □  Late  and  Over  budc 


Software  Engineering  Institute  CarnegieMellon 


How  Evolving  Trends  in  Systems  and  Software 
Technologies  Bode  Well  for  Advancing  the  Precision  of 
Technology  10 

Dr.  Kenneth  E.  Nidiffer 


©2008  Carnegie  Mellon  University 


Irregular  Challenges 


Catastrophic  Challenges 


Acquisition:  Life  of  a  Program  Manager  in  a 
System  of  Systems  and/or  Net-Centric  Operation. 
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Irregular  Challenges 


Catastrophic  Challenges 


Acquisition:  Effectively  Managing  Risk 


Defend 
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In  Depth 
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Today's 


A  Key  Challenge  Is  How  to  Obtain  a  Better  Alignment  of  Risk  Among 

the  Relevant  Stakeholders 
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Irregular  Challenges 


Catastrophic  Challenges 


Acquisition  Chaiienges:  Some  Drivers  That 
Increase  the  Risk  of  Acquiring  Software-intensive 
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Traditional  Challenges 


Disruptive  Challenges 
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Integration  Challenge  StSCks” 

Proprietary - - - — — - — f  Piug  &  Piay 

Architectures  and  Standards 

Need  Exists  to  Address  Both  Sides,  and  Do  So  with  Compressed  Delivery 
Schedules  via  Improvements  in  Systems/Software  Engineering 
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Irregular  Challenges  Catastrophic  Challenges 


Acquisition  Performance  -  Fiexible 
Boundary-Crossing  Acquisition  Structure 
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Traditional  Challenges  Disruptive  Challenges 


2005  study  confirmed*: 

•  In  advanced  knowledge-based  organizations,  management’s  desire  for 
the  flow  of  knowledge  is  greater  than  the  desire  to  control  boundaries 

•  Unlike  the  matrix  organization,  there  is  less  impact  on  the  dynamics  of 
formal  power  and  control 

•  Important  to  measure  the  system  in  terms  of  user  performance 

*  Using  Communities  of  Practice  to  Drive  Organizational  Performance  and  Innovation,  2005,  APQ  study 
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Ref:  Jim  Smith,  (703)  908-8221  .jds@sei.cmu.edu 
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Human  Element 


The  ability  of  organizations  to  compete  will  increasing  depend  on  the 

innovation  of  the  human  element 
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Catastrophic  Challenges 
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Society  Drivers:  Bimodal  Demographics  ~ 
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Disruptive  Challenges 


Average  Space  Industry  S&E  Workforce  Age  Distribution 


Trend:  Industry/Ggv’t  Will  Increasingly  Focus  on  Attra 

andMetalning  Systems  Engineering  Talen 
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Irregular  Challenges 


Catastrophic  Challenges 


Objective  is  for  Software  and  Systems  Engineering 
to  Become  More  Integrated  Versus  Separated 
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Irregular  Challenges  Catastrophic  Challenges 
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Human  Element  in  the  Work-Space  Environment 
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Managing  Multiple  Generations:  Cultural 
Differences 


Traditionalist 

1928-1945 


Baby-Boomer 
1946-  1 964 


Generation  X 
1965-  1980 


Generation  Y 
1980-2000 


■  Hard  VNorker 
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■  Prefer  informality 

■  Learns  quickly 

■  Communicates  directly 
&  immediately 

■  Wbnts  structure  & 
direction 

■  Seek  wDrk/life  balance 


■  Prefer  informality 

■  Learn  quickly 

■  Embrace  diversity 

■  Requires  supervision 

■  Indirect  communication: 
email  &  texting 

■  Seek  “demand” 
v\o1</life  balance 
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Trends  Affecting  the  Workforce 


rom 


Doers  differ  from  thinker^^  Doers  must  be  thinkers 
Assets  are  things  Assets  are  people 


Labor  is  an  expense  People  are  an  investment 


Lifetime  employments^  Lifetime  employability 


Top  down  control  Decentralized  decisions 

Localized  work^^  Networked  problems  solved 


Measure  for  results Measure  for  improvements 

Pfeffer  (1994) 
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Communication:  Increased  Capabilities  in  the 
Digital  Spectrum  Enables  Improvements  in 
Communication  and  Collaboration 


Irregular  Challenges 


Catastrophic  Challenges 


i - 1 - 1 - 1 - 1 - 1 - 1 - ^ 

Kilobit/Sec.  Megabit/Sec.  Gigabit/Sec.  Terabit/Sec. 

1,000  - 103  1,000,000  -  106  1,000,000,000-10®  1,000,000,000,000  -  1012 


Rule  #4:  The  best  companies  are  the  best  collaborators* 


*  Friedman,  Thomas  L.  “The  World  Is  Flat’,  Farrar,  Straus  and  Giroux,  2005 
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Irregular  Challenges 


Communications  Among  Systems  -Fostering  a 
Growing  interdependence  and  integration 
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Implication:  improvements  in  Collaboration 
Mechanisms  Are  Enabiers  for  System  and 
Software  Engineering  Success 
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Catastrophic  Challenges 


Problem  Identification:  Ultra-Large-Scale  (ULS) 
Systems  -  The  Software  Challenge  of  the  Future 


Irregular  Challenges 


Traditional  Challenges  Disruptive  Challenges 


Gather  leading  experts  to  study: 

•  Characteristics  of  ULS  systems 

•  Challenges  and  breakthroughs  required 

•  Promising  research  and  approaches 
Intended  outcomes: 

•  ULS  Systems  Research  Agenda 

•  Program  proposal 

•  Collaborative  research  network 


Ultra- Large-Scale 
Systems 

The  Software  Challenge 
of  the  Future 


I-  Software  BigmwrirrglnEtfliita 

Cl  uwf[i  r  k  HI 


About  the  Effort 

Funded  by  the  Army  (ASA  ALT) 

Staffing:  9  member  SEI  team;  13  member  expert  panel 


ULS  systems  study 
Study  lead  -  Linda  Northrop,  SEI 
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Systems  and  Software  Engineering:  Ten  Trends 


•  Greater  demands  on  systems  and  software  engineers  will  stimulate  growth  in 
the  field  -  nationally  and  internationally 


•  Industry/Gov’t  will  increasingly  focus  on  attracting,  training  and  retaining 
systems  and  software  engineering  talent  -  short  and  long  run  -  with  emphasis 
on  providing  a  Generation  Y  work  environment 


•  Increased  reliance  on  systems  and  software  engineering  processes  and 
technologies  to  effectively  manage  the  acquisition/”green”  space 


•  The  laws  of  Augustine’s  and  Moore  will  continue  to  hold  and  will  continue  to 
be  a  forcing  function  to  bring  the  fields  of  software  and  systems  engineering 
closer  together 


•  Improvements  in  program  risk-reduction  collaboration  mechanisms  will  be 
significant  enablers  for  increases  in  systems  and  software  engineering 
communication  and  “decision  velocity” 
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Systems  and  Software  Engineering:  Ten  Trends 


•  Increased  need  for  a  large  number  of  complex  systems  and  systems  of 
systems  will  lead  to  investments  in  research  and  technology 


•  Systems  and  software  engineers  will  continually  find  way  to  innovative  to 
reduce  complexity 


-  Increased  importance  of  modeling  and  simulation 


-  Increased  reliance  on  architectures  (top-down  and  bottoms-up) 


-  Increased  design  for  continuous  evolution  and  deployment  at  all  levels 
will  occur 


>  Understanding  users  and  their  context  will  evolve,  e.g.  leaner  system 
and  software  engineering  process  assets  on  projects 

•  Increased  customer  requests  for  system  and  software  engineering  support 
earlier  in  life  cycle 

•Shift  of  systems  and  software  engineering  focus  from  the  platform  to  systems 
of  systems 

•  Process  improvement  will  continue  to  be  important 
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